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The  optional  sampling  theorem  for  martingales  indexed  by  a  par¬ 
tially  ordered  set  Is  true  If  the  Index  set  is  directed.  However,  the 
corresponding  result  for  submartingales  indexed  by  a  partially  ordered 
set  is  generally  false.  In  this  paper  we  completely  characterize  the 
class  of  stopping  times  for  which  the  optional  sampling  theorem  is  true 
for  all  uniformly  bounded  submartingales  indexed  by  countable  partially 

ordered  sets.  By  assuming  a  conditional  Independence  property,  we  show 

/  2  * 

that  when  the  Index  set  1s(IT/the  optional  sampling  theorem  is  true  for 
all  uniformly  bounded  submartingales  and  all  stopping  times.  This  con¬ 
ditional  Independence  property  is  satisfied  in  cases  where  the  sub- 
martingales  and  stopping  times  are  measurable  with  respect  to  the  two- 
parameter  Wiener  process.  A  counterexample  shows  that  the  optional  sampling 
result  Is  false  for^R^when  rt^2  even  if  the  conditional  independence 
property  Is  satisfied/^ 


^  r,  rvz  ^f/l 


1 


OPTIONAL  SAMPLING  OF  SUBMARTINGALES  INDEXED  BY  PARTIALLY  ORDERED  SETS 

1.  Introduction 

Bochner  (1955)  formulated  the  martingale  theory  of  Doob  (1953)  for 
random  functions  on  a  directed1  Index  set  with  the  Intention  of  clarifying 
and  simplifying  several  probabilistic  concepts  in  terms  of  martingale 
concepts.  With  this  motivation  he  defined  martingales,  submartingales 
and  stopping  times  In  the  general  context  of  a  directed  Index  set  and  he 
stated  general  versions  of  the  martingale  convergence  theorem  and  the 
optional  sampling  theorem.  Since  that  time  several  authors  have  studied 
these  conjectures  and  found  that  the  general  case  of  directed  indices  re¬ 
quires  additional  hypotheses  to  obtain  generalized  versions  of  the  results 
for  linearly  ordered  index  sets.  On  the  question  of  martingale  conver¬ 
gence,  Krickeberg  (1956),  Helms  (1958)  and  Chow  (1960)  have  obtained 
generalized  versions  of  Doob's  (1953)  results  for  linearly  ordered  index 
sets.  See  also  the  monograph  of  Hayes  and  Pauc  (1970).  More  recently. 
Gut  (1976)  and  Gabriel  (1977)  have  studied  convergence  of  martingales 
indexed  by  directed  sets  and  applied  these  results  to  investigate  the  law 
of  large  numbers  for  multi parameter  stochastic  processes. 

Using  a  restricted  definition  of  stopping  time,  Chow  (1960)  proved 
that  the  optional  sampling  theorem  was  true  for  martingales  In  the  gen¬ 
eral  case  of  directed  index  sets.  Kurtz  (1977)  removed  Chow's  restric¬ 
tions  on  the  stopping  time  and  extended  the  results  to  the  case  when  the 
Index  set  is  a  topological  lattice.  In  addition  to  proving  an  optional 
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sampling  theorem  for  martingales  with  a  directed  Index  set,  Chow  (1960) 
also  showed  that  the  analogous  result  for  submartingales  was  false  even 
for  very  simple  examples.  Nevertheless,  the  optional  sampling  theorem  is 
true  for  submartingales  with  a  partially  ordered  index  set  if  suitable 
assumptions  are  made.  Haggstrom  (1966),  extending  the  work  of  Snell  (1952) 
on  martingale  systems  theorems  and  optimal  stopping  problems,  defined 
submartingales  indexed  by  a  tree.2  a  special  type  of  partially  ordered 
set  which  is  not  directed.  In  addition,  he  proved  a  version  of  the 
optional  sampling  theorem  for  a  special  class  of  stopping  times  called 
control  variables.2 

In  the  first  part  of  this  paper  (Section  2)  we  consider  the  optional 
sampling  theorem  for  submartingales  indexed  by  countable  (but  otherwise 
general)  partially  ordered  sets.  We  define  the  concept  of  reachability 
for  pairs  of  stopping  times  and  we  reformulate  Haggstrom' s  problem  for 
general  partially  ordered  time  sets.  The  concept  of  reachable  stopping 

times  generalizes  Haggstrom' s  notion  of  control  variable.  We  show  that 

\ 

if  a  stopping  time  t  is  reachable  from  a  stopping  time  o,  then  the  op¬ 
tional  sampling  theorem  is  true  for  all  submartingales  satisfying  a 
uniform  bound.  Conversely,  we  show  that  if  the  optional  sampling 
theorem  is  true  for  the  pair  t.o  of  stopping  times  and  for  any  uniformly 
bounded  submartingale,  then  t  must  be  reachable  from  o.  Thus,  we  obtain 
a  complete  characterization  of  the  case  In  which  the  optional  sampling 
theorem  Is  true  for  general  submartingales. 

In  the  second  part  (Section  3)  of  this  paper  we  assume  that  the  in¬ 
creasing  family  of  o-flelds  satisfies  a  special  conditional  Independence 
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property  that  can  be  defined  when  the  Index  set  Is  such  that  any  two 
elements  have  a  greatest  lower  bound.  This  Is  a  straightforward  generali¬ 
zation  of  the  conditional  Independence  property  that  Calroli  and  Walsh 
(1975)  define  for  the  Index  set  R*.1  Assuming  this  conditional  in¬ 
dependence  hypothesis,  we  can  show  that  If  the  Index  set  T  Is  a  tree  with 
respect  to  its  order  relation  s  and  If  o,t  are  stopping  times  with  as  t, 
then  t  Is  always  reachable  from  o.  Likewise,  assuming  the  conditional  In¬ 
dependence  property,  we  can  show  that  If  o  and  t  are  stopping  times  on 
2 

Z  and  a st,  then  t  Is  reachable  from  a.  Consequently,  the  optional  sampling 

theorem  Is  true  for  all  stopping  times  and  all  uniformly  bounded  sub- 

2 

martingales  defined  on  either  a  tree  or  on  Z  ,  when  the  conditional  in¬ 
dependence  property  Is  satisfied.  It  Is  a  simple  matter  to  extend  the 

2 

optional  sampling  theorem  for  the  case  of  the  Index  set  Z  to  the  case  of 
right  continuous  martingales  defined  on  R  .  A  counterexample  reveals 
that  the  optional  sampling  theorem  is  not  true  for  Zn  or  Rn  when  n>2. 


2.  Optional  Sampling  for  Submartlnqales  Indexed  by  Partially  Ordered  Sets 


2 . 1  Notation,  Conventions  and  Basic  Definitions 


We  will  let  T  denote  the  partially  ordered  index  set  in  this  paper 
and  except  for  one  case  In  Section  3,  we  will  always  assume  that  T  is 
countable.  We  will  use  s  to  denote  both  the  partial  order  relation  on  T 
and  the  usual  linear  order  relation  on  the  set  R  of  real  numbers,  but 
there  should  be  no  confusion  as  to  which  case  Is  meant.  Let  (Q,F\P)  denote 
the  underlying  probability  space  and  {f(t)  :  te  T}  a  family  of  sub  a- fields 
of  F  Indexed  by  T.  We  will  always  assume  that  F  and  each  F(t)  are  com¬ 
plete  with  respect  to  the  probability  measure  P.  Following  convention, 
we  omit  "a.s.n  from  all  equalities  and  Inequalities  between  random  func¬ 
tions,  although  we  Implicitly  assume  that  these  relationships  only  hold 
almost  surely. 

It  Is  straightforward  to  extend  the  usual  definitions  of  increasing 
family,  submartingale  and  stopping  time  to  the  case  of  a  partially  ordered 
index  set.  Nevertheless,  we  assemble  these  definitions  here  for  the  sake 


of  completeness.  The  family  {F(t)  :  teT}  Is  said  to  be  Increasing  with 
respect  to  s  If  ss  t  Implies  that  F(s)<=F(t).  A  mapping  X  :  T*Q-*-R  ts 
adapted  to  the  family  {f'(t)  :  t«T}  1fw+X(t,w)  is  F(t) -measurable  for 
each  t  In  T.  To  be  concise,  let  us  denote  the  random  variable  w-*-X(t,w) 
by  X(t).  A  mapping  X  Is  uniformly  bounded  If  there  exists  a  real-valued 
random  variable  X+  with  finite  expectation  E(X+)  such  that  j  X( t) | s  X+  for 
all  t.  A  submartinqale  X  with  respect  to  the  Increasing  family  {f(t)  :  t«T} 
Is  a  map  X  :  Txfl-^R  such  that  X  Is  adapted  to  {F(t)  :  trT},  such  that 


the  expectation  E(|X(t)|)  Is  finite  for  each  t  and  such  that  the  condi 
tional  expectation  satisfies 


(2.1)  X(s)  s  E(X(t) | f{$)) 


whenever  sst.  Similarly,  a  martingale  is  a  submartingale  for  which 
equality  holds  In  (2.1).  Note  that  in  this  paper  we  will  always  assume 
that  submartingales  are  uniformly  bounded. 

A  stopping  time  t  with  respect  to  an  Increasing  family  (F(t)  :  t  eT} 
Is  a  mapping  t  :  fl  +  T  which  satisfies  the  measurability  property 
{x*t}«f(t)  for  all  t.  Corresponding  to  each  stopping  time  r  there  is 
a  o-fleld  denoted  by  f(t)  and  defined  to  be  the  a-fleld  of  sets  A  in 
P  such  that  An  {t*t}  lies  In  F(t)  for  each  t.  If  a  is  a  stopping  time, 
let  5T(o)  denote  the  collection  of  all  stopping  times  t  such  that  as  r. 
The  optional  sampling  theorem  gives  conditions  under  which 


for  a  given  t  In  ST(o)  and  for  a  given  submartingale  X.  Let  os(a)  denote 
the  collection  of  all  t  In  st(o)  such  that  (2.2)  is  true  for  all  uniformly 
bounded  submartingales  X.  If  the  Index  set  is  the  set  of  Integers  ordered 
as  usual,  then  standard  theorems  (see  Neveu  (1975))  Imply  that  st{o)  mOS(a). 
As  Chow  (1960)  showed  with  a  simple  counterexample,  this  Is  not  true  for 
ge-ar^i  partially  ordered  Index  sets,  and  In  general  one  only  has 
os  )  c  sr(o) .  In  the  remainder  of  this  section  we  are  going  to  characterize 
OS[a)  In  terms  of  the  concept  of  reachability  which  we  discuss  next.  In 
Section  3  we  will  show  that  In  certain  special  cases  In  which  T  Is  not 


linearly  ordered  we  can  still  have  os(a)  * ST(a). 


2.2  Reachability 

Throughout  the  following  definitions  and  discussions  let  us  assume 
that  the  partially  ordered  Index  set,  the  underlying  probability  space  and 
the  Increasing  family  of  a-flelds  are  fixed.  Thus,  for  example,  "stop¬ 
ping  time"  will  mean  "stopping  time  on  T  with  respect  to  the  Increasing 
family  {*U)  :  teJ}.u 

Definition  1 

A  decision  function  is  a  mapping  <J>  :  Txfi  +  T  with  the  following 
properties: 

(2.3)  t  s  $(t,w) 

for  all  t  In  T,  and  almost  all  w  In  n.  Let  $(t)  denote  the  random  function 
u*»$(t,b)) .  Then  we  require  that 

(2.4)  (*(t)  »  s]  £  F{t) 

for  all  t,s  In  T.  Let  D  denote  the  collection  of  all  decision  functions. 

Note  that  D  depends  on  T,s  and  {f(t)  :  t « T} .  For  any  positive  Integer 

k  k 

k  let  t  denote  k  applications  of  the  random  function  4.  That  Is ,  <p  Is 

defined  recursively  by 

(2.5)  4*C+1(t,w)  »  $(<frk(t,w),w) 

wherewe  define  <^(t,w)  *t  for  all  t  and  <*>.  Also,  for  a  random  function 
a  :  fl-*-T  let  4(0)  denote  the  random  function  w-*-<>(o(u>),u)).  Thus,  $k+1  = 

♦(♦  (t))*4  ($(t)).  The  concept  of  a  decision  function  is  centraT  to  our 


development  of  the  notion  of  reachability.  Having  defined  decision  func 
tlons,  we  can  define  several  types  of  reachability  as  follows.  In  each 
of  the  following  definitions  assume  that  a  is  a  stopping  time  and  that  t 
is  a  mapping  x  :  such  that  (x  s  t}  is  F-measurable  for  each  t  in  T. 


Definition  2 


We  say  that  x  is  finitely  reachable  from  a  if  there  is  a  decision 
function  $  in  D  and  an  integer  k  such  that 


Let  FB(a)  denote  the  collection  of  all  x  which  are  finitely  reachable 
from  o. 


Definition  3 


We  say  that  x  is  strongly  reachable  from  o  if  there  is  a  decision 
function  <p  in  D  such  that  the  limit 


exists  almost  surely  and  is  equal  to  x.  The  limit  (2.7)  is  interpreted 

in  terms  of  the  discrete  topology  on  T.  That  is,  for  almost  all  u  we  have 

lira  ^(o(u),b))  »t  if  and  only  if  $n(a(w),w)  *  t  for  some  integer  n.  Let 
k-*» 

SR(o)  denote  the  collection  of  all  x  which  are  strongly  reachable  from  a. 
Definition  4 

We  say  that  x  is  reachable  from  a  if  there  is  a  sequence  {t^}  of  xfc 
in  f7?(o)  such  that 


I 


8 


(2.8) 


Tim  P(t.  *t)  *  0 
!<-*«  K 


Let  R(a)  denote  the  collection  of  all  t  which  are  reachable  from  o. 

In  general  one  has  the  following  relationships  between  the  collec¬ 
tions  of  random  functions  we  have  just  defined: 

(2.9)  FR[o)  c  SR(o)  c  j?(o)  a  OS(a)  c  sr(o) 

In  particular,  note  that  the  relationship  R(o)=OS(o)  characterizes  those 
pairs  of  stopping  times  for  which  the  optional  sampling  theorem  is  true 
for  uniformly  bounded  submartingales.  In  the  present  subsection  we  will 
show  that  f’R(a)  c5i?(o)  c/?(0)  cos(a)  <=ST(o),  and  in  the  next  subsection  2.2 
we  will  show  the  converse  relation  OS[a)  <=fl(a).  First  we  prove  the  fol¬ 
lowing  simple  theorem. 

Theorem  1 

Suppose  that  o  is  a  stopping  time.  Then  the  following  relationships 
are  true: 

(2.10)  FR(a)  c  SR(a)  <=  i?(a)  c  ST[a) 

Proof 

We  divide  the  proof  Into  four  steps  in  which  we  prove  (i)  FR{a)  =  sr(a) 
(11)  FR{a)  =SJ?(o),  (ill)  Sff(o)  cfl(a)  and  finally  (1v)  R(a)<=ST[a)  to  obtain 

(2.10) . 

(1)  We  will  show  that  for  <J>  e  D  and  t  «ST(o)  we  always  have  «(t)€  ST{a). 
Having  shown  this,  one  easily  deduces  by  Induction  that  $>k(o)  *-ST(a)  for 
any  integer  k*0  and  hence  that  FR(a)cST(a).  It  is  clear  that  for  $  e  D, 
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TcSr(o)  we  always  have  as$(x),  so  It  only  remains  to  show  that  the 
measurability  condition  {$(x)  *  s}  <  F(t)  is  satisfied.  Since  ts<|>(t)  a.s., 
for  each  t  the  event 

(2.11)  {♦(t)  ■  t}  -  {♦(t)  ■  t,  ts  t} 

has  zero  probability.  Note  that  the  event  (<j>(x)  3  t,  is  t)  can  be  written 
as 

(2.12)  o {{<}>( s)  3  t}  n  {x3s}  :  sst} 

Since  <j>  is  a  decision  function  and  since  x  is  a  stopping  time  the  events 
(<j>(s)  *  t}  and  {x*s}  are  F(s) -measurable  and  hence  F(t) -measurable  for 
all  sst.  It  follows  from  (2.12)  that  {<j»(x)=t,  xst}  is  F(t) -measurable, 
and  from  the  fact  that  (2.11)  has  zero  probability  and  that  F(t)  is 
complete  it  follows  that  {<j>(x)3t}  is  F(t)-measurable.  Hence,  4>(x)  is 
a  member  of  sr(o). 

(ii)  Suppose  that  a  is  a  stopping  time  and  k  is  a  nonnegative 

integer.  Define  :  Txft-*-T  as 

(2.13)  i|/(t)  *  t  if  <j>k(o)  3  t 
i|>(t)  3  <J>(t)  if  $k(a)  *  t 

If  If 

from  (1)  we  see  that  $  (a)  is  a  stopping  time  and  hence  the  events  {4>  (a)  3  t} 

L 

and  (o) 3  t}  are  F(t) -measurable.  It  follows  easily  that  satisfies 
the  measurability  condition  (2.4).  The  condition  (2.3)  is  easy  to  see 
also,  and  thus,  ip  Is  a  decision  function.  Note  that  for  each  integer 
jzQ,  we  have  tp^+1(o)  3  ^+1(a)  if  ^(a)  3  $k(a) .  If  <^(a)  3  $k(a) ,  then 


10 


m  k 

It  is  easy  to  see  from  the  definition  of  that  i|>  (o)  =  <j>  (a)  for  all  m>  j.- 
Thus,  if  jsk,  then  <^(o)  *  4»k(o) .  Consequently,  lim  ^J(a)  exists  and 

.  ,  j-H» 

equals  4>  (o).  Hence,  <(>  (a)  c  SR(a) . 

(iil)  This  is  easy  to  see.  If  t eSR(a),  then  there  is  a  decision 

|c  1/ 

function  <j>  such  that  lim  <j>  (a)  »t.  By  taking  t.  3  <p  (o)  in  (2.8),  we  see 

k-*o  K 

that  t«  *(o) . 

(1v)  Suppose  that  (2.8)  holds  for  some  t  in  R(o).  If  A  denotes  the 
set  symmetric  difference,  then 

(2.14)  {t  =  t}  A  {rk  -  t}  c  {t*t} 

and  from  (2.8)  it  follows  that 

(2.15)  lim  P({r*t}  A  {x.  *t})  *  0 

k—  K 

Since  x^  €  FR(a)  <=  ST{o) ,  the  event  (x^  *  t}  is  i’(t) -measurable  for  each  k. 

The  completeness  of  F( t)  and  (2.15)  imply  that  {t  *  t}  is  also  F(t)-measurable. 
Similarly,  o*xk  a.s.  for  all  k  implies  that  asr  a.s.,  and  thus,  xcSr(o). 

The  inclusion  relations  in  (2.10)  generally  cannot  be  replaced  by 
equalities.  The  following  simple  examples  Illustrate  this  fact. 

Example  1.  FR(a)*SR(o) 

Let  T  denote  the  set  of  positive  Integers  ordered  In  the  usual  way. 

Let  x  be  any  random  function  taking  values  in  T  such  that  P(r  *  t)  >0  for 
all  t.  Define  f(t)  as  the  o-field  generated  by  {t  *  s}  for  sst.  Let  a*l. 
Then  with  respect  to  {F(t)  :  t<T),  o  is  a  stopping  time  and  x  is  strongly 
reachable  from  o  but  not  finitely  reachable  from  a. 


f 
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Example  2.  SR[a)  *  R(a) 

Let  T*  {0}  u  :  na  1}  and  order  T  in  the  usual  way.  Let  t  be  any 

random  function  taking  values  in  T  -  {0}  such  that  P(r  =  t)>0  for  all  t*0. 

Define  f( t)  as  the  a-field  generated  by  {t=s}  for  sst,  and  let  a  =  0.  In 

this  case  F(0)  is  the  trivial  a-fleld  and  any  decision  function  $(t)  is 

almost  surely  constant  at  t*0.  Thus,  we  must  have  <$>(a)  for  some  n  and 

1  k 

there  Is  always  a  non-zero  probability  P(t<^0  that  <|>  (a)*r  for  all  k. 

Therefore,  t  Is  not  strongly  reachable  from  a.  However,  by  choosing  a 

decision  function  with  4>(0)  for  sufficiently  large  n  we  can  make  the 
k 

probability  that  4)  (o)*t  for  some  k  arbitrarily  small,  and  thus,  r  is 
reachable  from  a. 

Example  3.  R(o)*ST(o) 

We  present  an  example  from  Chow  (1960)  to  show  that  os{a)  *ST{a)  by 
constructing  a  stopping  time  t  in  sr(a)  which  does  not  belong  to  05(a). 

In  the  next  theorem  we  will  show  that  5(a) c 05(a)  and  thus,  this  stopping  . 
time  t  cannot  belong  to  5(a).  Unlike  the  previous  examples  which  used 
linearly  ordered  index  sets,  to  show  5(a)*5r(a)  we  must  use  a  partially 
ordered  Index  set.  Let  T  consist  of  three  points  a,  b,  c  with  the  order 
relations  asb  and  a  sc.  Let  t  be  a  random  function  taking  only  the  values 
b  and  c  each  with  probability  one-half.  Let  F(t)  be  the  a-field  generated 
by  t *  t  for  each  t  In  T.  Then  f( a)  Is  the  trivial  a-field,  and  F(b)»F(c). 
If  t*b  or  t»c,  define  X(t)  *  1  if  t  *  t  and  X(t)  *  -1  if  t a  r.  Let  X(a)  *  0. 
Then  E(X(b)|F(a)) «  E(X(c)|F(a))  s  X(a)  and  X  is  a  uniformly  bounded  martin¬ 
gale  on  T.  However,  E(X(t)|F(o))  ■  -1 <  X(a)  and  hence  t*  05(a). 

In  special  cases  we  can  have  some  equalities  in  (2.10).  For  example. 
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the  argument  of  example  3  Is  easily  extended  to  show  that  R(o)  •  ST[o)  in 
case  T,s  is  linearly  ordered.  In  Theorem  3  we  will  show  that  Sff(c)*i?(a) 
if  the  index  set  is  a  special  type  of  partially  ordered  set  called  a  tree. 
In  subsection  2.3  we  will  give  a  more  general  condition  for  the  equality 
SJ?(a)  *  J?(a).  Note  that  FR[a)  3  SR(o)  *  f?(a)  whenever  the  index  set  is 
finite. 

Intuitively,  t  Is  reachable  from  a  if  there  is  a  finite  sequence  of 
decisions  which  reaches  t  from  a  with  arbitrarily  large  probability.  The 
sequence  Is  ($J(a)  :  Osjs'k}  and  the  decisions  must  be  nondecreasing 

with  respect  to  the  partial  order  (2.3)  and  each  decision  <j>J+*(a)  must  be 
measurable  with  respect  to  the  previous  decision  ^(a)  as  required  in 
(2.4).  Given  this  definition  of  reachability,  it  is  not  surprising  that 
the  optional  sampling  theorem  is  true  for  reachable  pairs  of  stopping 
times.  Indeed,  one  merely  applies  the  result  for  submartingales  indexed 
by  integers  as  we  now  show. 

Theorem  2 

Suppose  that  o  is  a  stopping  time.  Then  the  following  relationship 
is  true: 

(2.16)  R(o)  c  OS(a) 

Proof 

•  Suppose  that  X  is  a  submartingale  uniformly  bounded  by  X+,  and  let 
♦  be  a  decision  function.  Suppose  that  A  is  an  event  in  F{o).  Consider 
E( X(<p(ct) )  1A)  and  rewrite  it  as 
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(2.17)  I  Jt  E(X(t)l(0(s).t)n(0.s)nA) 

Since  the  event  {$(s)*t}  n  (o*s}n  A  is  F(s) -measurable  and  since  X  is 
a  submartingale  with  respect  to  (F(t)  :  t«  T},  we  must  have 

(2.18)  E(X(t)l{(>(s),t}n{a«s}nA)  2  E(X(s)  1{^(S) 

*t}n{a*s}nA^ 

for  sst.  Substituting  this  expression  in  (2.17)  and  summing  over  t  gives 
<M9>  I  E(X(s)  Wa) 

which  Is  equal  to  E(X(o)l^).  Thus,  we  have  shown  that 

(2.20)  E(X(*(o))|F(a))  a  X(a) 

Applying  the  principle  of  mathematical  induction,  it  follows  that  (2.20) 

I* 

remains  true  If  4  (o)  replaces  <|>(a).  Consequently,  we  have  Fff(a)  c os(a). 

Applying  the  above  result  to  proving  the  theorem  is  straightforward. 
Let  {xk}  be  a  sequence  In  FR(a)  which  converges  to  t  in  the  sense  of  (2.8). 
Rewrite  X(xk)  as 

(2.21)  X(tk)  -  X(x)  +  (X(tk)  -X(t))1 

and  note  that  from  our  previous  result  we  have 

(2.22)  E(X(xk)|F(o))  a  X(o) 

for  each  k.  Substituting  the  equality  relation  (2.21)  into  (2.22)  gives 
for  each  k  the  inequality 
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(2.23)  E(X(t)|F(o))  +  E((X(Tk)-X(T))l  )|F(o))  *  X(a) 

By  assumption  |X(xk)-X(x)|  is  uniformly  bounded  by  2X+.  Since  P(x*xk)-*-0 
as  k-*-®,  it  follows  that 

(2.24)  lim  E((X(tJ  -  X(x))l  |F(o))  -  0 

k-*®  K  TTk 

Applying  (2.24)  to  (2.23)  gives  the  desired  result. 

Before  proceeding,  let  us  discuss  the  relationship  of  reachability 
to  Haggstrom's  control  variables.  Haggstrom  (1966)  considered  a  special 
type  of  partially  ordered  index  set,  called  a  tree,  and  a  special  type  of 
stopping  time  which  he  called  a  control  variable.  A  tree  T.s  is  a  par¬ 
tially  ordered  set  which  consists  of  finite  sequences  (tj.tg.. . . ,tn)  where 
t^  are  elements  of  some  abstract  set  which  we  leave  unspecified.  The  set 
T  must  have  the  property  that  if  (tj,t2,. . . ,tn)  lies  in  T,  then  so  does 
(ti»t2»...  ,tn)  for  each  k,  lsksn.  The  partial  order  s  on  T  is  defined 
so  that  sst  for  two  sequences  t«  (t^tg....,^)  and  *•  (slts2,...,s  ) 
if  and  only  If  msn  and  s^»tj  for  each  i,  is  Ism.  Associated  with  T 
Is  an  Increasing  family  which  we  denote  by  {F(t)  :  tcT}  as  before.  A 
control  variable  t  is  a  random  function  t  :  Q-^T  with  the  property  that 
for  each  nil,  the  events  {t-x}  and  {(tj.tj,...  ,tn»tn+1)  s  t}  are  F(t)- 
measurable  for  t*  (tj.tj.... »tn).  In  addition.  Include  the  empty  sequence 
o  In  T  and  assume  that  the  events  {<?*x}  and  {(t^sx)  are  F(o) -measurable 
for  each  sequence  of  the  form  (t^)  In  T.  The  following  proposition  shows 
that  Haggstrom's  control  variables  are  equivalent  to  random  functions 
reachable  from  the  constant  stopping  time  o*<?  in  our  formulation. 


Theorem  3 

Suppose  that  T,s  is  a  countable  tree  and  let  t  :  G-*-T  be  a  random 
function.  Then  r  is  a  control  variable  if  and  only  if  it  is  reachable 
from  the  constant  stopping  time  oao.  Moreover,  in  this  case  SR(o)  s  R(o) . 

Proof 

Suppose  first  that  x  is  a  control  variable.  Then  for  each  t»  (tj.tg,... ,tn). 
in  T  define  <fr(t)  as 

(2.25)  ♦(t)*«(t1.t2,...,tn,tn+1) 


1  f  (^1*^2**  *  *  ’^n'Si+l^  ^  snd 
(2.26)  <*»(t)  -  t 

if  (t^tgf.  «tn,tn+1)  ii  for  any  tn+1*  Note  that  since  T,s  is  a  tree, 

the  events  {(tj,t2,. . . »tn»tn+1)  s  x}  are  disjoint  for  different  tn+1  and 

hence,  <p  is  well-defined.  To  see  that  <p  is  a  decision  function  as  defined 

in  Section  2,  we  must  check  that  (2.3)  and  (2.4)  are  satisfied.  Property 

(2.3)  is  clear  from  the  definition  of  <p.  Since  x  is  a  control  variable, 

the  events  {(tj.tg,... »tn,tn+1) s  x}  are  F(t) -measurable  for  t«  (tj.t-,... ,tn) 

and  hence,  property  (2.4)  Is  satisfied.  Now  let  us  show  that  11m  <p  (a) 

k-*» 

exists  and  is  equal  to  x,  so  that  x«SJ?(o).  Consider  the  events  {t/x} 
and  {t  < x}  as  follows.  If  t*x(w),  then  by  cgnstruction  we  have  <t>(t,u)  •  t 
and  hence,  11m  (t,w)at.  If  t<x(u),  then  by  construction  we  have 

|(-MB 

t  < <P( t,u»)  st(id).  If  t«  (tlft2,...,tn)  and  x(w)  »  (x1(w),T2(w),...,xn+k(u))), 

1  k 

then  (x1(w),x2(ta>),...,xn+j(w))  s  ( t ,a»)  for  lsjsk.  Hence  <j>  (t,w)-x(u) 


% 
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k  k 

and  11m  $  (t,w)  * t(<u).  Thus,  we  see  that  11m  <t>  (t,w)  s  t(w)  whenever 

k-*»  k-*»  . 

tst(w).  In  particular,  we  must  have  that  lim<r(o)*T.  It  follows 

k-*» 

that  t  is  strongly  reachable  from  o. 

To  show  the  converse,  assume  that  t  is  reachable  from  o.  We  must 

show  that  {t‘  st}  is  F(t) -measurable  for  t »  (trt2,. . .  ,tn)  and  t'*(t1,t2 . t, 

In  T.  First  suppose  that  t  Is  finitely  reachable  franc  so  that  t»4>k(c) 
for  some  decision  function  $  and  some  Integer  k*0.  Thus,  we  have 

(2.27)  {t'sr}  *  u  ($J(o)  s  t,  t' s  4^+1(c)} 

j-0 

As  we  proved  in  Theorem  1,  <^(o)  is  a  stopping  time  for  each  j  and  hence, 
{^(c)*s}  is  F(s) -measurable  and  hence  F(t) -measurable  for  all  sst. 

Since  4>  is  a  decision  function,  the  event  { t*  s  <p( s) }  is  F(s) -measurable, 
and  hence  F(t) -measurable  for  sst.  We  can  write 

(2.28)  {<*>j(o)st,  t'sft))*  u  ({<*>j(o)*s}n  (t's»(s)}) 

sst 

and  thus,  the  event  j$J(c)st,  t‘  s$j+1(c)}  must  be  F(t) -measurable.  From 
(2.27)  It  follows  that  {t*  st)  is  also  F(t) -measurable,  and  consequently, 
each  t  In  FR(o)  is  a  control  variable. 

To  see  that  t  In  R(o)  are  also  control  variables,  let  {tjJ  be  a 
sequence  in  FR{o)  which  converges  to  t  In  the  sense  of  (2.8).  For  each  k 
we  have 


(2.29)  If  1T|(}  4  c  (T.Tk) 


We  have  just  showed  that  ft'  st^}  Is  F(t) -measurable  for  each  k.  Ar¬ 
guing  from  (2.29)  as  we  did  In  part  (1v)  of  the  proof  of  Theorem  1,  we 
deduce  that  {t *  st)  Is  also  F[t) -measurable.  Hence,  each  t  In  R[o)  Is  a 
control  variable. 

Thus,  we  have  shown  that  all  control  variables  are  strongly  reachable 
from  o  and  that  all  t  which  are  reachable  from  o  are  control  variables. 
Using  the  result  SR[o)  c r(o)  from  Theorem  1,  we  see  that  In  fact  SR(o)  * 
R(o)  In  this  case  and  the  notions  of  strongly  reachable,  reachable  and 
control  variable  are  equivalent. 

2.3  Optimal  Stopping  Problem  and  Converse  Optional  Sampling 

We  now  turn  to  proving  the  converse  optional  sampling  theorem,  namely 
that  OS(o )  cj?(o).  To  do  this  we  first  consider  an  optimal  stopping  prob¬ 
lem,  defined  on  partially  ordered  Index  sets,  which  Is  a  generalization 
of  Haggstrom's  (1966)  stopping  problem  on  trees. 

Theorem  4 

Suppose  that  the  mapping  c  :  T  Is  uniformly  bounded  and  adapted 

to  (F(t)  :  t<  T}.  For  any  random  function  t  :  fl+T  define  n(t,T)  as 

(2.30)  ir(t.r)  »  E(c(r)l?(t)) 

Define  ir(t)  as 

(2.31)  ir(t)  *  ess  1nf{ir(t,x)  :  re  i?( t) } 

and  let  n  denote  the  mapping  from  Txjj  to  B  defined  by  (2.31).  Then  it 
satisfies  the  equation 
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(2.32)  ir(t)  ■  1nf{E(ir(s)|f(t))»  c(t)  :  t<s} 

for  all  t  in  T.  Furthermore,  for  any  stopping  time  o  and  e>0  there 
exists  t  In  527(a)  such  that 

(2.33)  ir(o)  +  e  i  ir(o,x) 

Proof 

Note  first  that 

(2.34)  ess  1nf{ir(t,x)  :  x<  27(a)}  ■  ess  inf{ir(t,x)  :  X€F2?(a)} 

To  see  that  this  Is  true  let  x  be  an  element  of  2?(a)  and  let  {x^}  be  a 
sequence  of  FR(a)  converging  to  x  as  in  (2.8).  It  is  easy  to  see  that 
c(xfc)-^c(x)  in  probability,  and  hence,  there  exists  a  subsequence  of 
{c(xk) }  which  converges  almost  surely  to  c(x).  Let  |c(xk)}  also  denote 
this  subsequence.  Since  c  Is  uniformly  bounded,  the  conditional  expec¬ 
tations  ir(t,xk)  defined  In  (2.30)  must  converge  to  ir(t,x)  almost  surely. 
The  equality  of  (2.34)  follows  from  this. 

Define  ff(t)  as 

(2.35)  flf(t)  *  1nf{E(ir(s)  |F(t)),  c(t)  :  t <  s} 

We  will  prove  that  if(t)*ir(t)  In  order  to  demonstrate  (2.32).  It  Is  easy 
to  show  that  ir(t)2if(t).  In  order  to  do  this,  let  x  be  an  element  of 
FR[o)  and  let  x*0k(t)  for  the  decision  function  $.  Then  the  following 
relation  must  be  true. 

(2.36)  e(t)  •  I  «<*W(.»  l,(t).s  *  c(t) 
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LI 

Note  that  $  (s)cFR(s)  for  each  s  such  that  t<s.  Thus,  from  (2.34) 
and  (2.31)  we  see  that 

(2.37)  E(c(*k'1(s))|/(s))  2  »($) 

and  from  the  definition  (2.35)  of  rf( t)  we  must  have 

(2.38)  E(c(^k”1(s))|^(t))  i  if(t) 

for  each  s  such  that  t<s.  Conditioning  (2.36)  with  respect  to  F(t)  and 
using  (2.38),  we  obtain 

(2.39)  E(c(t)|F(t))  i  if(t)  . 

Since  t«f7?(t)  In  (2.39)  was  chosen  arbitrarily,  the  relation  (2.31)  and 

(2.34)  Imply  that  ir(t)ii?(t). 

The  opposite  Inequality,  ir(t)sif(t),  is  slightly  harder  to  prove,  but 
It  follows  easily  once  we  show  that  (2.33)  is  true  for  constant  stopping 
times.  As  shown  in  Chow,  Slegmond  and  Robbins  (1971),  the  essential 
Inflmum  (ess  Inf)  has  the  property  that  It  Is  almost  surely  equal  to  an 
Inflmum  over  a  countable  collection  of  random  variables.  Using  (2.31)  and 

(2.34) ,  we  see  that  there  Is  a  countable  set  {xk}  of  random  functions  in 
FR[t)  such  that 

(2.40)  ir(t)  ■  1nf{ir(t,Tk)  :  ksl} 

In  Theorem  1  we  proved  that  Fff(t)  cSF(t)  and  therefore,  there  exist  de¬ 
cision  functions  4>k  such  that  for  each  k 

(2.41)  11m  ♦jj(t)  -  Tk 


20 


Define  the  integer-valued  random  function  k*  to  be  the  least  Integer 
k*l  such  that  ir(t)  +  e  ^  tt(  t  *Tk) .  The  random  function  k*  Is  thus  defined 
almost  everywhere  and  It  Is  F(t) -measurable.  Let  be  defined  so  that 
d>(  r)  *  r  for  all  r  such  that  t*r,  and  such  that  <j>(r)  *  \*(r)  for  tsr. 

Then  the  mapping  T xu+T  is  defined  for  almost  all  u  and  by  defining 
$(r,w)  »r  where  k*(<o)  Is  not  defined,  one  easily  sees  that  <|>c  D.  Moreover, 

(2.42)  lim  *n(t)  »  t.* 
iv*« 

Hence,  must  be  In  SR(t)  and  by  definition  of  k*  it  must  be  true  that 
ir(t)  +esir(t,Tk*). 

We  can  now  show  Tr(t)sir(t)  as  follows.  For  e>0  and  for  s  such  that 
t<s,  choose  t  in  SR(s)  such  that 

(2.43)  it(s)  +  e  i  tt(s ,t) 

l( 

Let  r»11mo  (s)  for  0.  Define  a  new  decision  function  >j>  as  iji(r)  =  <j>(r) 
for  ssr,  ij>(t)«s  and  i|»(r)*r  for  all  other  r.  Then  lim  iji  (t)  =  lim  <j>k(s) 

k-*oo  k-+aa 

and  hence,  t  Is  an  element  of  Sfl(t)  and  also  an  element  of  R(t).  From 

(2.43)  It  follows  that 

(2.44)  ir(s)  +  e  i  E(c(t) |f(s)) 

Conditioning  (2.44)  with  respect  to  F( t)  we  obtain  E(tt(s)  |f(t))  +e  a  ir(t,t) 
and  consequently,  E(ir(s)lF(t))  +e*ir(t).  Since  e  was  arbitrary  we  obtain 
E(ir(s)|F(t))  air(t).  It  Is  clear  that  c(t)2ir(t),  and  thus,  we  have 
Tf(t)  2  TT(t). 

To  finish  the  proof  we  must  demonstrate  the  inequality  (2.33X.  for 
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arbitrary  stopping  times  a.  From  above  we  know  that  for  each  t  there 
exists  Tt«  S2?(t)  such  that 

(2.45)  ir(t)  +  e  2  ir(t,Tt) 

for  a  given  e>0.  Let  D  be  such  that 

(2.46)  11m  At)  -  T. 

k—  r  z 

Define  a  new  decision  function  $  such  that  <j>(t)  ^ <br( t)  If  rst  and  o*r, 

and  <fr(t)*t  If  ait.  In  this  case  the  limit  T*lim  <J>k(c)  exists  and  is 
.  k-*» 

equal  to  lim  Or)  whenever  a*r.  Thus,  r  c  Sff(o)  and  from  (2.45)  it 
k~  r 

follows  that  ir(a) +e2ir(a,t). 

Theorem  5 

If  a  Is  a  stopping  time  on  T,s  with  respect  to  (F(t)  :  te  T}  then 
OS(a)  *R(o). 

Proof 

We  have  already  shown  In  Theorem  £  that  fl(o)  cos(a).  Thus,  it 
suffices  to  show  OS(a)  <=R(o).  Suppose  that  r  «  OS(a).  We  apply  Theorem  4 
to  the  optimal  stopping  problem  with  cost  function  c(t)  *  1  It  follows 
that  ir  In  (2.31)  is  a  submartingale  uniformly  bounded  by  1.  Since  we 
assume  that  t «05(o),  the  optional  sampling  Inequality  (2.2)  is  true  for 
X  *  it  and  thus  E(tt(t)  |F(o))  2  ir(o) .  Since  it(t)  Is  clearly  0  by  definition 
of  c  and  since  it(o)  2  0,  we  have  7 r(a)  *0.  From  (2.33)  there  exist  in 
Sfi(o)  such  that  for  each  positive  Integer  k 

(2.47)  ir(c)  +  £  2  Tr(o,Tk) 
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Noting  that  it(o)  »0  and  ir(o,Tk)  *P(xk  *  t|?(a))  in  (2.47),  we  obtain  the 
following  result: 

(2.48)  P(t^  *  t|f(o)  )  s 

Taking  the  expectation  of  (2.48)  gives  P(xk  * t)  s p  Since  each  xk  is 

strongly  reachable  from  o,  according  to  Theorem  1  It  is  also  reachable 

from  a,  and  hence  there  are  xk«  Fff(o)  such  that  P(xk  *xk)  s[.  It  follows 
2 

that  P(tk»r)  for  each  k  and  consequently  re  H(a). 

The  following  corollary,  which  follows  from  (2.48),  improves  the  ap¬ 
proximation  (2.8). 

Corollary  5 

For  each  x«  r{o)  there  exist  xke  SH(a)  such  that 

(2.49)  lim  P(tu*t|f(o))  3  0 
k— 

where  the  convergence  in  (2.49)  is  uniform  on  a  set  of  probability  one. 

When  the  Inflmum  in  (2.32)  is  a  minimum,  we  may  refine  the  results 

of  Theorem  5  and  In  some  cases  prove  that  all  reachable  random  functions 
are  in  fact  strongly  reachable.  We  present  these  results  below  in  Theorem 
7  and  Its  corollaries.  The  following  simple  theorem  shows  that  the  in¬ 
flmum  is  actually  a  minimum  for  a  large  class  of  index  sets.  If  T,s 
Is  a  partially  ordered  set  and  t«  T,  then  we  say  that  s  is  an  Inmediate 
successor  of  t  and  write  t«s  if  tss  and  If  tsrss  for  no  r  other  than 
t  or  s. 

Theorem  6 

% 

Suppose  that  the  partially  ordered  Index  set  T,s  in  Theorem  4  is  such 
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that  each  t  In  T  has  at  most  a  finite  number  of  immediate  successors. 

Then  the  inflmum  in  (2.32)  is  a  minimum. 

Proof 

Note  that  since  n  is  a  submartingale  we  have  that  E(tt(s)  |.F(t))  s 
E(ir(r) |f(t))  for  each  tsssr.  Since  for  each  r  such  that  t<r  there  is 
an  Inmediate  successor  s  of  t  such  that  ssr,  we  have 

(2.50)  1nf{E(ir(s)|?(t),  c(t)  :  t  <  s}  =  1nf{E(ir(s)|F(t),  c(t)  :  t  <-s} 

The  inflmum  on  the  right  hand  side  of  (2.50)  is  taken  over  a  finite  set 
of  s  by  assumption,  and  consequently  it  is  a  minimum. 

Theorem  7 

Let  a  be  a  stopping  time  with  respect  to  {F(t)  :  tcT}  and  let  re  fl(a). 
Let  ir  be  the  uniformly  bounded  submartingale  defined  by  (2.31)  in  Theorem  4 
with  the  cost  function  c(t)slT<t.  Suppose  that  there  exists  <t>  such  that 

(2.51)  ir(t)  *  E{ir(<fr(t))|F(t)} 

for  each  t  and  $(t)  *t  if  and  only  if  Tr(t)  3c(t).  Then  r€  <?($k(a))  for 

each  k,  and  In  particular,  4> (a)  si  for  all  k.  Furthermore,  whenever  the 

limit  llmV^o)  exists,  it  is  equal  to  x. 
k-*» 

Proof 

If  P  Is  a  stopping  time,  then  from  (2.51)  it  follows  that 

(2.52)  it(p)  »  E{*(4>(P))|F(P)} 

Letting  p  * 4>k(a)  successively  for  kaO  we  see  that  {-n-(q>k (a) ) }  is  a  one 
parameter  martingale  with  respect  to  {F($k(o))} .  Since  x€  j?(o)  implies 
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that  ir(o)  *0  and  since  irsO,  we  see  that  tt($  (o))  a0  also  for  each  k. 

k 

Using  the  same  argument  as  in  Theorem  5,  we  deduce  that  t e  f?( <}>  (o)).  It 

k  k 

follows  that  <J>  (a)  s  t  a.s.  from  the  definition  of  R(<t>  (a)).  Finally, 

Jy 

to  prove  the  last  assertion  of  the  theorem  suppose  that  lim  $  (a)  exists 
v  k+i 

so  that  (a)  *<j>  (a)  for  some  k.  The  condition  that  <j>(t)  =t  if  and 

only  if  ir(t)*c(t)  implies  that  Tr(d>k(a))  *c(<f>k(a)).  Since  ir(d>k(a) )  *  0, 

k  |r 

it  follows  that  c(r(o))«0  and  hence,  <J>  (a)*r.  The  following  corol¬ 
laries  are  immediate  consequences  of  Theorems  6  and  7. 

Corollary  7.1 

Assume  the  same  conditions  as  in  Theorem  7.  Suppose  that  the  index 
set  T  has  the  property  that  for  any  s,  t  in  T  with  s<t,  there  is  no 
Infinite  sequence  {rn}  in  T  such  that  s<rn<rn+i<t  ^or  n*  Then  for 
the  decision  function  d>  satisfying  (2.51)  we  have 

(2.53)  lim  <j>k(a)  *  t 
k-*- 

Corollary  7.2 

If  the  partially  ordered  index  set  T,s  is  the  set  of  integer  n-tuples  Zn 
with  the  coordinate-wise  partial  ordering,  then  SR(o)  -  R[o) . 

Corollary  7.3 

If  the  partially  ordered  index  set  T,s  is  finite,  then  fr{o)  *sr(o)  *R(a). 
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3.  Conditional  Independence  and  Optional  Sampling 

For  particular  types  of  index  sets  T,s  and  increasing  families 
{F(t)  :  t«  T}  it  may  be  true  that  for  any  pair  t.o  of  stopping  times  with 
air  that  t  is  reachable  from  a.  For  example,  this  is  true  if  T,s  is 
countable  and  linearly  ordered.  In  this  section  we  present  two  other 
general  cases  where  this  is  also  true  and  where  the  index  set  is  not 
linearly  ordered. 

To  begin  we  make  two  assumptions,  one  concerning  the  index  set  T,s 
and  the  other  concerning  the  collection  (F(t)  :  te  T}  of  a-fields.  Namely, 
assume  that  for  any  two  elements  t,  s  of  T  there  is  a  greatest  lower 
bound  tAS  of  t  and  s  with  respect  to  the  partial  ordering  of  T.  This 
is  true,  for  example,  if  T.s;  is  a  tree,  as  defined  in  Section  2,  or  if 
T,s  is  a  lattice  such  as  Zn  or  Rn  with  the  coordinate-wise  partial  or¬ 
dering.  In  the  second  case,  the  ith  coordinate  of  tAS  is  minjt^.s^} 
where  t^  and  s^  are  the  ith  coordinates  of  t  and  s  respectively.  The 
second  assumption  we  make  is  that  (F(t)  :  tc  T}  satisfies  the  following 
conditional  Independence  property. 

Definition  5 

The  Increasing  family  {F(t)  :  t«  T}  satisfies  the  conditional  in¬ 
dependence  property  If  for  each  s  and  t  in  T,  the  o-fields  F(s)  and  F(t) 
are  conditionally  Independent  given  F(sxt). 

This  conditional  independence  property  was  defined  for  the  case  of 

2 

T  »  R+  by  Cairoll  and  Walsh  (1975)  in  their  study  of  stochastic  integrals 

on  the  plane.  The  multi  parameter  Wiener  process  on  r"  defined  by  Park  (1970) 

▼  % 
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generates  o-flelds  which  satisfy  the  conditional  Independence  property. 

If  T,s  Is  an  Index  set  with  the  property  that  any  two  elements  of  T  have 
a  greatest  lower  bound,  then- we  can  construct  a  simple  example  of  a 
collection  of  o-flelds  with  the  conditional  independence  property  as 
follows.  Let  {x(t)  :  t«  T}  be  a  collection  of  independent  random  variables 
and  let  F(t)  be  the  o-fleld  generated  by  the  collection  {x(s )  :  sst}  of 
random  variables.  It  is  not  hard  to  see  that  the  collection  {f(t)  :  t<  Tj 
so  defined  satisfies  Definition  5. 

We  will  show  that  if  T,s  is  either  a  tree  or  Z*"  with  the  coordinate- 
wise  ordering  and  if  {F(t)  :  tcT}  has  the  conditional  independence  pro¬ 
perty,  then  SR(o)*ST(o)  for  all  stopping  times  o.  The  first  case  we 
consider  is  that  for  which  T,s  is  a  countable  tree  as  defined  in  Sec¬ 
tion  2. 

Theorem  8 

Suppose  that  T,s  is  a  countable  tree  and  that  the  increasing  family 
{f(t)  :  tc  T}  has  the  conditional  independence  property.  If  a  is  any 
stopping  time,  then  Sfl(o)  * sr(o) . 

Proof 

Having  proved  that  Sff(a)  <=£T(a)  in  Theorem  1,  we  need  only  prove 
ST{o)  <=sh(o).  For  a  given  stopping  time  t  we  will  construct  a  decision 
function  $  such  that  for  any  stopping  time  a  with  osT,  the  limit  lim  <j>k(a) 

k-KD 

exists  and  is  equal  to  t. 

Fix  t  in  T  and  define  $(t):  fl-*-T  as  follows.  For  each  immediate 
successor  s  of  t,  let  A$  denote  the  F(t)-measurable  event 
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- - 

(3.1)  As  «  {<*>  :  P(ssr|F(t))  >  0} 

Note  that  for  each  s  the  definition  (3.1)  implies  that 

(3.2)  P(Asn  {sst})  »  P((sst)) 

Suppose  that  s  and  s'  are  immediate  successors  of  t  with  s*s'»  and  let 
sir  and  s'  sr'.  Because  T,s  Is  a  tree,  we  must  have  r*r'  and  rA r'  » 
sas*  *t.  Thus,  the  conditional  Independence  property  implies  that 

(3.3)  P(t  »  r|f(t))  P(T*r'|p(t))  a  0 

Summing  (3.3)  over  all  r,r'  such  that  s  s  r  and  s'  s  r'  gives 

(3.4)  P(sst|p(t))  P(s’ st|p(t))  *  0 

From  (3.4)  and  (3.1)  it  follows  that  for  each  s*s' 

(3.5)  P(AsnAs,)=0 

Using  the  assumed  completeness  of  F(t)  and  redefining  the  A$on  sets 
of  measure  zero  if  necessary,  we  deduce  from  (3.2)  and  (3.5)  that 

(3.6)  |sst)cA$ 

(3.7)  A$n  A$(  •  9 

for  all  s,s'  such  that  t«s,s'  and  s*s'.  Let  At  denote  the  event  in 
P(t)  defined  by 

(3.8)  At  ■  (fl  -  {As  :  t  ♦$} )  u  {t  -  t} 


V 
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Me  can  define  $(t)  In  terms  of  the  sets  At  and  A$  for  t«>s  as  follows. 

(3.9)  *(t,w)  *  t  If  iiic 

(3.10)  <j>(t,u))  s  s  If  wcAs-At 

Property  (3.7)  and  the  definition  (3.8)  insure  that  4>(t)  is  a  well-defined 
function.  Property  (3.6)  insures  that  if  tsx,  then  <j>(t)s-r.  Further¬ 
more,  if  tsx  and  <fr(t)*t,  then  t*r.  If  a  is  any  stopping  time  such  that 

as  x,  then  0  (a)sr  for  each  k.  Since  T.s  is  a  tree  and  has  the  property 

Ic 

mentioned  in  Corollary  7.1,  the  limit  lim  <p  (a)  exists  almost  surely.  By 
construction  this  limit  p  is  such  that  psx  and  <j>(p)*p.  Consequently, 

P  *t. 

The  property  of  a  tree  that  makes  Theorem  8  possible  is  that  for  each 

s,s'  such  that  t«s,s*  and  s*  s'  we  have  {r  :  ss  r}  n  {r1  :  s'  s  r'}  =  0. 

This  property  will  not  hold  for  more  general  partially  ordered  index 

sets  such  as  T*Zn.  Nevertheless,  we  can  adapt  the  proof  of  Theorem  8 

2 

to  the  more  general  case  of  T*Z  . 

Theorem  9 

Suppose  that  T * Z^  and  s  is  the  coordinate-wise  partial  ordering  of 
Z^.  Furthermore,  suppose  that  the  increasing  family-{F(t)  :  te  T}  satis¬ 
fies  the  conditional  independence  property.  If  a  is  any  stopping  time, 
then  SR{a)  •  3T(a). 

Proof 

As  In  Theorem  8,  for  a  given  stopping  time  t  we  will  construct  a 

decision  function  <p  such  that  11m  $k(a)  ■  r  for  any  stopping  time  a  with 

k— 
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as  t. 

Fix  t-ftj.tg)  In  Z2  and  define  <>(t)  :  n-*-Z2  as  follows.  Define"  the 
events  Kj  and  as 

(3.11)  K.  »  u  {t«  (t,it2  +  n)} 

1  n>0  4  c 

(3.12)  Ky  -  u  {t»  (t^nut-)} 

6  m>0  1  c 

The  conditional  Independence  property  Implies  that  F(( t^tj  +  n))  and 
^((t^  +  m.tj))  are  conditionally  Independent  given  FUtj.tg))  for  any 
m,niO.  Thus,  we  have 

(3.13)  P(x-  (tj.tg  +  nijFU))  P(t«  (t1  +  m.t2)|^(t))  *  0 

for  all  n,m> 0.  From  (3.13),  (3.11)  and  (3.12)  It  follows  that 

(3.14)  P(K1|^(t))  PtKglF’tt))  «  0 


Define  the  F(t)-measurable  events  A(tltt2+l)  and  A(t1+l,t2)  aS 

(3.15)  A(tl,t2H)  *  1“  :  P(K1|P(t))  >  0} 

(3.16)  A(t1+l,t2)  “  ‘  A(t1,t2+1) 


It  Is  not  difficult  to  see  that 

(3.17)  P<A(t11t2+1)  0  Kl)  ‘  P<Kl> 


and  that 


V 
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<3-18>  p<*(t1.Vi)"llt>*0 

From  this  point  on  the  proof  follows  Theorem  8.  Using  the  assumed 
completeness  of  F(t)  and  redefining  A^t  ^  ^and  A^+1  on  sets  of 
measure  zero  if  necessary,  we  deduce  from  (3.17)  and  (3.18)  that 

(3.19)  Kx  c 

(3.20)  Kg  c 

where  A^+unA^^j-J  and  A^^^u  A^+1^»fl.  Let 
A(ti>t^)  *  lT*  (ti»t2)f  40(1  define  ♦((t1,tg))  as: 

(3.21)  ♦((t1,t2),o»)  ■  (tj.tg)  if  a)  c  A(tj,tg) 

(3.22)  ♦((t1,t2),w)  -  (tj+l.tg)  lf  “»e  ^tj+l.tgf^t^tg) 

(3.23)  4>((t1,t2),«)  «  (tj.tg+l)  1f  W€  A(t1,t2+l)"A(t1,t2) 

I# 

For  this  decision  function  <p  (o)st  for  any  stopping  time  a  such  that 

ost.  Since  Z2  also  has  the  property  of  Corollary  7.1,  the  limit  lim  <j>k(o) 

k-*<» 

exists  almost  surely  and  Is  equal  to  t. 

We  cannot  extend  the  proof  of  Theorem  9  to  the  case  of  T*  Zn  for 
n>2.  The  following  example  shows  that  in  fact  the  result  is  not  generally 
true  for  n  >  2. 

Example  4.  /?(o)*ST(o)  when  T«Z3  and  when  the  conditional  Independence 


property  holds  true. 
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Without  loss  of  generality  we  construct  the  example  for  the  Index 

set  T  defined  as  the  Cartesian  product  {0,1} *  {0,1}  *  {0,  },  a  subset  of 
3 

Z  ,  namely  the  vertices  of  the  unit  cube.  One  can  easily  extend  this 

A 

example  to  one  on  all  of  ZJ  or  to  Zn  for  some  n  >  3.  Let  o»  {o>.  :  Is  1  s  3} 
with  P({wj})«£  for  each  1,  and  let  F  be  the  collection  of  all  subsets 
of  fl.  Define  three  random  functions  a,  0,  y  from  a  onto  {0,1}  as  follows. 

a(cuj)  ■  o(oj^)  »  0(0)2)  ■  a(oj^)  *  0 

*  o(o)g)  »  0(0)7)  »  a(o)g)  3  1 

B(o)j)  «  0(o^)  *  B(o>5)  «  B(o)g)  *  0 

0(u3)  *  0(“»4)  *  8(0)7)  »  B(o>8)  *  1 

YUj)  •  y(u3)  «  Y(wg)  *  Y (^7)  *  0 

y(t^)  *  y(“>4)  *  Y(ug)  ■  y(w8)  3  1 

It  Is  not  difficult  to  check  that  o,  B,  y  are  independent  random  functions. 
We  can  now  define  the  o-flelds  {f(t)  :  t«T}  in  terms  of  these  random 
variables.  Let  F((0,0,0))  be  the  trivial  o-field  {0,0}.  The  a-field 
^( (1,0,0) )  is  generated  by  o,  F((0,1,0))  Is  generated  by  0,  f((0,0,1)) 
is  generated  by  y.  f((l,l,0))  is  generated  by  o  and  0.  F((1,0,1))  is 
generated  by  o  and  y»  F((0,1,1))  Is  generated  by  0  and  y.  and  f( (1,1,1)) 

Is  generated  by  all  three  random  variables— hence,  f((1,1,1))  mF.  Since 
o,  0,  and  y  are  independent.  It  Is  easy  to  check  that  {p(t)  :  t«  T}  satis¬ 
fies  the  conditional  Independence  property. 

Define  a  submartingale  X  on  T  as  follows.  Let  X((l,l,l))(uu)  ■ 
X((l,l,l))(o>6)  -  -1  and  let  X((l,l,l))(»i) »  1  for  1  *  3,6.  Define  X(t)  -  0 
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for  t*  (1,1,1).  To  check  that  X  is  a  submartingale,  it  suffices  to 
show  that  E(Xft,l,l»|m))*0,  for  t«  (1,1,0),  (1,0,1).,  (0,1,1).  A 
simple  calculation  shows  that  E(X(l,l,l))|f((l,l,0))  is  equal  to  1  if 
ut *  <Dj ,o)2 »«*>7 »‘*>g  and  it  is  equal  to  0  if  u  *  The  other  con¬ 

ditional  expectations  are  similar. 

Finally,  define  t(w)  »  (1,1,0)  if  <d«  let  t(u)  ■  (1,0,1)  If 

cj»  Ug'Uyi  let  t(u>)  ■  (0,1,1)  if  at* Mg;  and  let  t(<d)  ■  (1,1,1)  If 
It  Is  easy  to  check  that  t  is  a  stopping  time.  Let  a*  (0,0,0).  Then 
a  simple  calculation  'shows  that 

E(X(t)|j(o))  -  E(X(t))  »  (-l)J  +  (0)|  *  jf  0  -  X(o) 

Consequently,  t  4  OS{a)  and  from  Theorem  2  It  follows  that  t  dR(o).  Thus, 
R(a)  *  ST(o). 

To  conclude  the  results  of  this  paper  we  state  an  optional  sampling 
theorem  which  follows  easily  from  Theorems  8  and  9  and  Theorem  2. 

Theorem  10 

Suppose  that  T,s  is  either  a  countable  tree,  Z2  or  R2.  Let  the  in¬ 
creasing  family  {f(t)  :  teT}  satisfy  the  conditional  Independence  pro¬ 
perty,  and  let  X  be  a  uniformly  bounded  submartingale  with  respect  to  this 
increasing  family.  If  T»R2  then  also  let  X  be  right  continuous  in  the 
sense  that 

11m  X(s)  •  X(t)  for  all  t 
s-*t,tss 

If  a  and  t  are  stopping  times  with  ost,  then  E(X(x) |F(a))  z  X(a). 


' 


Proof 

For  T*Z2  or  T  a  tree  the  proof  follows  Immediately  from  Theorems 

8,  9  and  2.  For  T*R2  one  proceeds  as  for  R1  by  taking  limits  of  stopping 

2 

times  taking  only  finitely  countable  many  values  in  R  and  using  the 
result  for  T»Z2.  Since  there  are  very  few  changes  from  the  one-parameter 
case,  for  example  as  given  in  Neveu  (1965),  we  omit  the  proof. 
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4.  Conclusions 

We  have  shown  that  for  a  given  pair  o,t  of  stopping  times  such  that 
os  t  on  a  countable  partially  ordered  set,  the  optional  sampling  inequality 

(4.1)  E(X(r)|F(o))  a  X(o) 

is  true  for  all  uniformly  bounded  subroartinqales  X  If  and  only  If  t  is 
reachable  from  o.  This  result  stands  in  sharp  contrast  to  the  martingale 
results  of  Chow  (1960)  and  Kurtz  (1977).  If  X  is  a  uniformly  bounded 
martingale  and  if  the  Index  set  is  directed,  then  (4.1)  is  true  for  any 
stopping  times  o,r  such  that  osr.  Note  that  our  result  does  not  require 
that  the  Index  set  be  directed. 

Our  characterization  of  the  collection  os[a)  of  stopping  times  t  for 
which  (4.1)  Is  true  shows  that  optional  sampling  is  intimately  associated 
with  sequential  sampling  problems— namely,  reachable  stopping  times  are 
defined  in  terms  of  sequential  decision  functions  as  described  in  Section 
2.  Thus,  even  for  the  case  of  a  partially  ordered  index  set,  the  optional 
sampling  theorem  is  necessarily  a  one-parameter  result.  As  we  have  shown 
in  Section  2,  the  optional  sampling  theorem  is  true  for  general  uniformly 
bounded  submartingales  if  and  only  If  the  stopping  times  are  reachable 
and  hence  If  and  only  If  the  theorem  can  be  reduced  to  its  one-parameter 
varslon. 

In  certain  special  cases  discussed  in  Section  3  it  is  possible  to 
show  that  the  optional  sampling  inequality  (4.1)  Is  true  for  all  stopping 
times  and  all  uniformly  bounded  submartingales.  To  obtain  such  results 
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we  assumed  that  the  Increasing  family  of  a-fields  satisfied  a  conditional 
independence  property  originally  given  by  Cairoli  and  Walsh  (1975).  This 
property  is  possessed  by  a-fields  generated  by  multiparameter  Wiener 
processes,  for  example.  Thus,  we  proved  the  optional  sampling  theorem 
for  the  special  cases  when  T  is  a  tree  or  when  Ts  Z  or  R  .  The  counter- 

o 

example  of  Section  3  shows  that  the  theorem  is  not  true  for  T*  Z  . 

The  preceding  results  completely  characterize  the  situations  in  which 
the  optional  sampling  theorem  is  true  with  no  restriction  on  the  sub¬ 
martingales  other  then  uniform  boundedness.  If  further  restrictions  are 
placed  on  the  submartingales,  it  may  be  possible  to  obtain  different 
optional  sampling  results.  For  example,  if  X  has  a  Doob  decomposition4, 
it  is  easy  to  apply  Kurtz's  (1977)  result  to  show  that  (4.1)  is  satisfied 
for  all  stopping  times.  Thus,  suppose  X(t) *  M(t) + A(t)  where  M  is  a 
martingale  and  A  is  an  increasing  process  in  the  sense  that  A(s)s  A(t) 
if  sst  in  the  partially  ordered  index  set.  Then  if  the  index  set  is 
directed,  Kurtz's  result  implies  that  E(M(t)|f(o))  *  M(a)  for  all  stopping 
times  o,x  such  that  ost.  It  is  clear  that  A(o)sA(t)  and  hence 
E(A(t)|F(c))  i  A(a).  Thus,  E(X(T)|f(a))  *  X(a)  is  also  true. 

Of  course,  the  fact  that  the  optional  sampling  theorem  is  not  generally 
true  in  the  case  of  partially  ordered  index  sets  means  that  not  all  sub¬ 
martingales  have  such  Ooob  decompositions.  Indeed,  if  t  is  not  reachable 
from  some  stopping  time. d  where  ost,  then  the  submartingale  it  of  Theorem  5 
has  no  Ooob  decomposition.  For  otherwise  (4.1)  would  be  true  for  X*tt 
and  the  argument  of  Theorem  5  would  imply  that  t  is  reachable  from  a,  a 
contradiction. 
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Despite  the  fact  that  reachability  Is  a  rather  stringent  condition 
on  stopping  times  taking  values  in  partially  ordered  sets,  there  are  some 
cases  in  which  the  stopping  times  naturally  have  this  reachability  pro¬ 
perty.  Washburn  (1979)  has  considered  optional  stopping  problems  of 
the  type  described  in  Section  2.3  for  which  the  index  set  T  is  either 
R  or  a  collection  of  subsets  of  R  .  In  these  problems  the  stopping 
times  are  reachable  as  defined  here  provided  that  they  take  at  most 
countably  many  values  In  the  partially  ordered  index  set.  Since  the 
index  sets  In  these  and  other  applications  of  interest  are  nondenumerable. 
It  is  important  to  extend  the  concept  of  reachability  and  the  results 
of  Section  2  to  uncountable  Index  sets.  In  particular,  one  would  like 
to  extend  the  results  of  Section  2  to  the  case  where  decisions  are  made 
continuously.  Thus,  one  mast  make  sense  of  differential  equations  of  the 
form 

(4.2)  £•♦<*(,)) 

where  <p  Is  a  decision  function  and  s-»*t(s)  is  a  continuous  trajectory  of 
stopping  times.  In  (4.2)  we  assume  that  the  time  set  is  some  linear  space 
such  as  Rn.  In  order  that  the  path  s -*» t(s)  should  Increase  we  must 
assume  that  the  components  of  $  are  all  nonnegative. 

The  previous  discussion  has  been  carried  out  only  at  the  heuristic 
level  and  all  the  conjectures  discussed  will  require  rigorous  proof.  Note 
that  Kurtz  (1978)  has  Investigated  a  class  of  continuous  parameter  stop¬ 
ping  times  which  satisfy  a  differential  equation  of  the  form  (4.2). 

Kurtz  (1978)  Investigated  the?  ulti parameter  stopping  times  while 
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studying  processes  X(t)  (here  tcR*)  of  the  form 

N  ft 

(4.3)  X(t)  =»  X(0)  +  l  a.W.(  S,(X(s))ds) 

1-1  1  1  >0  1 

where  are  Independent  Wiener  processes.  The  1th  component  of  the 
stopping  times  r(t)  Is  given  by 

(4.4)  t1  (t)  »  J  S^XfsJJds 

Note  that  represents  a  random  time  change  for  the  Wiener  process  W... 

It  seems  likely  that  the  stopping  time  t  defined  by  (4.4)  will  be  reachable 
In  some  sense  appropriate  for  the  Index  set  Fn  and  hence  that  the  optional 
sampling  theorem  for  submartinqales  is  true  for  these  stopping  times. 

Note  that  Kurtz  (1978)  used  the  martingale  version  of  theorem  which  he 
had  proved  earlier  in  Kurtz  (1977). 
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7.  Footnotes 

1.  A  directed  set  is  a  partially  ordered  set  with  the  additional  property 
that  every  two  elements  In  the  set  have  a  common  upper  bound. 

2.  See  Section  2  for  these  definitions. 

3.  The  reals  and  nonnegative  reals  are  denoted  by  R  and  R+,  respectively, 
and  the  Integers  are  denoted  by  Z.  The  Cartesian  products  are  denoted 
Rn,  R”  and  Zn,  respectively. 

4.  See  Doob  (1953)  for  the  discrete  Index  version  or  Meyer  (1966)  for 
the  continuous  index  version. 


